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Introduction 

From  the  gleam  in  a lover’s  eye  to  the  dazzling  brilliance  of  breaking 
waves,  we  are  surrounded  by  examples  of  non-matte  surface  luster.  The  luster  of  a surface 
is  a quality  of  its  appearrance.  Specific  terms  we  use  for  describing  surface  luster  include 
glossy,  shiny,  sheen,  metallic,  and  matte.  Since  surface  luster  is  often  important  for 
identifying  materials,  and  is  a conspicuous  feature  of  human  visual  perception,  it  is 
important  to  understand  how  to  compute  these  qualities. 

Traditional  theories  dealing  with  the  perception  of  suface  luster  have 
focused  on  factors  such  as  disparity,  color  constancy,  and  lightness(see  for  example  [Evans, 
1974]  [Lavin,  1973]),  but  none  of  them  sufficiently  accounts  for  human  performance  in 
describing  surface  luster.  This  conclusion  comes  from  observing  that  people  recognize  non- 
matte lusters  in  both  achromatic  television  images  and  in  photographs,  where  neither  color 
nor  disparity  are  present.  Our  reasons  for  dismissing  lightness  will  become  clear  later  on. 
On  what  properties  then  do  these  descriptions  rest? 

For  non-matte  lusters,  the  interaction  of  the  illumination  with  the 
specular  component  of  the  object’s  reflectance  results  in  the  formation  of  small  regions  or 
sub-regions  which  perceptually  seem  to  have  source-like  properties.  If  we  can  detect  which 
regions  in  an  image  have  source-like  properties,  we  may  use  their  existence  to  provide  a 
symbolic  modifier  to  the  surfaces  that  contain  them.  This  modifier,  we  suggest,  is  the 
surface  luster.  A secondary  consequence  is  that  we  will  have  simplified  object  recognition  by 
"factoring  out"  some  effects  of  the  illumination. 

This  idea  was  also  put  forward  by  Beck[Beck,  1974]  in  similar  terms. 
Beck  also  exhibited  a strong  piece  of  evidence  for  this  view,  in  the  form  of  a picture  of  a 
vase  with  and  without  highlights,  (reproduced  in  figure  1)  The  vase  with  highlights  looks 
shiny,  the  vase  without  looks  matte.  Other  images  with  non-matte  lusters  are  in  figure  2.  A 
light  source  effect  is  the  interaction  between  the  illumination  and  the  specular  component  of 
a surface’s  reflectance  that  gives  rise  to  source-like  regions.  This  work  classifies  light  source 
effecu  according  to  how  they  arise,  and  suggests  methods  for  detecting  the  regions  they 
produce. 
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Some  Conventions 

Let  n be  the  unit  normal  to  an  element  of  surface.  We  then  define  the 
angles  between  this  vector  and  the  source  and  view  vectors  as  follows* 


Sov^rcC 


I = tVcidtrct 
angle 

emergent 

angle 

Aase 


ang( 


The  model  for  surface  reflectivity  used  here  was  taken  from  [Horn,l975l 

and  is 

R(I,£,G)-s(2I£-G)n»mI 

where 

I-cos(i) 

£-cos(e) 

G-cos(g) 

s-relative  strength  of  specular  component 
[between  0 and  I] 

m-relative  strength  of  matte  component 
• l-s 

n-degree  of  sharpneu  of  specular  component 

An  analysts  of  how  well  this  model  matches  real  surfaces  may  be  found  in  [Forbus,in  prepX 
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Analysis  of  the  problem 

There  is  a natural  division  of  light  source  effects  into  three  catagotiei. 
by  the  gross  aspects  of  the  physical  situation  in  which  they  occur.  Non-ntnemonic  names  are 
given  to  these  effects  to  avoid  contusion  with  perceptual  terms.  Below  is  an  overview 
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Type  I effects  are  those  that  are  due  to  an  object's  curvature.  In 
perceptual  terms  they  correspond  to  the  highlights  on  curved  objects.  Some  examples  of 
regions  they  cause  appear  In  figure  3. 

Type  2 effects  are  those  which  are  caused  through  the  observer  viewing 
a virtual  image  of  a source  by  the  specular  component  of  a planar  surface.  Perceptually 
they  correspond  to  shiny  patches  and  other  highlights.  Examples  of  these  regions  may  be 
found  in  figure  4. 

Type  3 effects  occur  when  the  region  that  is  specularly  reflecting  the 
source  is  small,  or  when  the  virtual  Image  of  the  source  is  small.  They  often  correspond 
perceptually  to  point  specularlties.  An  example  Is  in  figure  5. 

Because  of  these  physical  differences,  different  detection  methods  are 
required  for  each  type.  Let  us  now  analyze  each  in  turn. 
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Figure  5 
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Type  1 Light  Source  Effects 

A light  source  reflected  In  a curved  specular  surface  gives  rise  to  a 
highlight.  This  is  caused  by  a type  I light  source  effect 

I have  observed  that  humans  see  non-linear  intensity  gradients  as  caused 
by  either  surface  curvature  or  non-uniform  illumination  To  recognize  highlights,  one  must 
be  able  to  distinguish  them  from  object  curvature.  Let  us  examine  a simple  situation  for 
insight. 

In  figure  6,  we  have  the  equations  derived  for  the  Intensity  across  a 
one  dimensional  profile,  assuming  both  the  source  and  the  viewer  are  very  far  away  from  a 
uniformly  curved  surface.  We  see  that  the  object  will  give  rise  to  a "hill"  in  intensity,  with  a 
seperate  peak  superimposed  on  top.  The  position  of  the  peak  and  its  extent  correspond  with 
the  places  on  the  surface  where  the  source  is  specularly  reflated  Figure  7 shows  the  same 
equation  graphed  for  various  n and  s.  Notice  that  a lower  n yields  a wider  peak,  thus 
"smearing"  the  mirror  effect  of  the  specular  component  By  sweeping  the  surface  normal, 
the  curvature  reveals  to  us  the  specular  component 

To  determine  what  parameters  are  relevant  to  perceiving  highlights,  a 
number  of  different  Intensity  profiles  were  used  to  generate  images,  either  on  a tv  screen  or 
transparencies  for  viewing  with  a light  table.  I will  call  the  contribution  from  the  specular 
component  the  peak,  and  the  rest  of  the  intensity  the  surround.  A set  of  pictures  was 
produced  with  the  equation  derived  In  figure  6,  and  the  results  looked  like  reasonable 
cylinders(see  figure  8). 

Several  other  analytic  approximations  for  the  peak  were  tried  on  a 
constant  surround,  with  different  combinations  of  surround  intensity  and  peak  height. 
Since  they  all  appeared  as  highlights,  the  exact  shape  of  the  peak  cannot  matter,  so  long  as 
it  is  not  a discontinuous  step  in  intensity.  The  lowest  contrast  of  the  peaks  was  around  0 08, 
so  contrast  is  not  very  important,  although  the  highlight  looks  "better"  with  higher  contrast. 

Next  a surround  corresponding  to  the  matte  component  of  intensity  of  a 
cylinder  was  used,  but  the  width  of  the  peak  as  a percentage  of  the  width  of  the  surround 
was  varied.  All  but  the  broadest  (peak  width  75H  of  the  total  wldth)appeared  as  highlights. 
This  suggests  that  the  width  Is  not  critical,  so  long  as  the  surround  Is  visible.  A similar  set 
of  peak  widths  was  then  superimposed  over  a constant  surround.  On  peaks  that  were  wider 
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than  about  20t  of  the  surround,  there  was  no  clear  Interpartation  as  a highlight. 

These  results  Indicate  that  context  Is  an  Important  factor  In  classifying 
the  results  of  this  type  of  light  source  effect  If  the  local  context  Is  rlght(second  derivative 
of  Intensity  non-zero),  a peak  will  be  Interperted  as  a highlight,  subject  to  the  Ilmlu  above. 
Otherwise  the  peak  must  be  reasonably  narrow  and  not  a step  change  In  Intensity  to  be 
Interperted  In  this  manner. 
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Figure  6 
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Type  2 Light  Source  Effects 

When  the  surface  being  viewed  is  flat,  a specular  component  will  create  a 
virtual  image  of  the  source  at  some  set  of  viewing  angles.  This  virtual  image  of  the  source 
Is  called  a type  2 light  source  effect 

In  the  limiting  case  of  a mirror  (s-I),  one  can  resolve  all  the  details  of  the 
field  of  view  for  that  angle.  However  most  surfaces  also  contain  a considerable  matte 
component  so  only  very  rough  characteristics  of  the  region,  such  as  average  local  intensity 
and  average  local  gradients  are  preserved. 

A virtual  image  of  a source  should  have  the  same  properties  as  a real 
source.  Hence,  If  we  can  detect  light  sources,  we  can  detect  type  2 light  source  effectt.  It  has 
been  claimed  that  source  detection  may  be  a side  effect  of  a lightness  computationlLavin. 
19731  However,  [Uilman4975l  demonstrated  this  is  unfeasible,  and  defined  an  autononxMis 
operator,  the  S-operator,  which  detects  sources  in  an  achromatic  mondrian  image. 

The  S-operator  solves  for  the  strength  of  a source  by  checking  the 
Intensities  and  gradients  of  the  region  and  a neighbor,  which  are  both  assumed  to  have  the 
same  orientation  and  the  same  Illumination.  It  is  based  on  the  observation  that  a source 
should  have  a higher  intensity  than  its  gradients  would  suggest  To  make  this  notion  more 
precise,  I shall  re-derlve  the  S-operator  here. 

Let  L-incident  illumination 

r|,2-reflectance  of  surface  i.2 
Il,2-Intensity  on  surface  1,2 
C|,2-Intensity  gradients  across  surface  1,2 

where  the  intensity  and  gradients  are  measured  at  points  close  to  the  boundary  between  the 
two  regions. 

Then 

I|-(l|r|)*S  I2-L2r2 

where  S-iource  strength 

Gi-Gor|  G2-Gor2 

L2-L|«God 

where  d is  the  distance  between  points  of  measurement  and 

Go-Ilhimination  gradient 
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we  want  to  solve  for  S, 

S-l|-Liri 

S-Ii-r|(L2-Go<l) 

then 

S-I|-<(l2G|)/C2)*Gid 

Notice  that  we  have  the  source  strength  in  terms  of  quantities  which  we 
can  measure  in  the  intensity.  Now  let  us  remove  the  restriction  that  the  orientation  of 
surfaces  1 and  2 remain  the  same.  To  do  this  we  must  create  a new  expression  for  the 
gradient  across  a surface. 

There  is  a foreshortening^  distance  due  to  the  viewing  angle 


SO  li-  c.os(e} 


Thus  the  incident  gradient  should  be  divided  by  cos(e).  We  must  also 
consider  the  reduction  in  intensity  due  to  absorbtion  and  beam  spread.  For  small  distances 
it  is  resonable  to  use  a linear  approximation. 
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So  we  now  have  the  gradient  G as  proportional  to  $in(i)/cos(e).  There 
are  several  other  effects  which  are  important,  but  since  they  are  hard  to  put  in  an  analytic 
form,  and  are  less  general,  I shall  postpone  them  until  later.  For  now  let  us  see  the  result  of 
using  our  new  expression  for  the  gradient. 

Let  Go  be  a constant  of  proportionality  which  is  specific  to  the 
illumination.  Then 

r|Go-G|cos(e)/sin(i)  r2Coo<}2cos(eMx)/sin(iK() 
where  a-the  angle  between  the  planes.  Then 

S-Ii-<2G|/G2Xcos(e)sln(i+a)/co$(e*a)sin(i)]4G|d(cos(e)/sln(l)) 

Notice  that  we  no  longer  have  S only  in  terms  of  quantities  directly 
measured  from  the  image.  The  introduction  of  a non-zero  angle  a between  the  surfaces 
forces  us  to  consider  their  relative  orientation.  Therefore  adding  ntore  regions  will  not  help 
the  analysis,  for  each  region  will  introduce  another  angle. 

We  can  estimate  the  effect  of  this  new  term  by  considering  the  maximum 
value  of  S we  can  get  if  there  is  no  source  involved. 

S-I|D-<cos(e)sin(i4e()/cot(e^)sin(i))»Godcos(e)/sin(i)] 


which  reduces  to 


S-I|[(sin(a)cos(i«e)«Godcos(e)cos(e*«i))/sin(i)cos(eK()] 

We  can  of  course  take  the  partial  derivatives,  but  they  are  not  too 
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revealing.  When  one  considers  the  rational  function  which  multiplies  I|,  we  discover  first  of 
all  that  d should  be  kept  as  small  as  possible  for  good  accuracy,  and  that  the  only  time  it 
gets  very  large  is  when  i>0  or  eHX-pl/2,  which  correspond  to  uniform  lighting  and  to  total 
obscuration,  and  thus  is  no  surprise.  In  fact,  the  value  rarely  gets  larger  in  magnitude  than 
I.  Therefore  we  should  be  able  to  get  a threshold  which  varies  according  to  the  intensities 
we  measure,  and  use  the  s-value  so  computed  as  a discriminant. 

Now  let  us  re-conslder  the  other  factor  affecting  the  intensity  gradient. 
If  the  source  spreads  out  spatially,  the  angle  of  incidence  will  be  slightly  different.  An 
analysis  of  the  etfea  this  has  on  gradients  may  be  found  in  [Herskovlts  tc  Binford,  19701 
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Even  more  important  are  the  effects  caused  by  the  lack  of  spatial 
uniformity  in  actual  light  sources  and  the  effects  of  mutual  illumination.  To  handle  these 
in  any  analytic  fashion  is  very  difficult.  For  an  example  of  a simple  case  see  tHorn,I975l 
For  this  reason  a better  analytic  model  for  gradients  was  not  undertaken.  There  are  some 
predictions  which  may  be  rrrade  however  using  the  rough  approximation. 

Suppose  we  shine  an  additional  source  of  light  perpendicular  to  one 
surface,  and  not  the  other.  Since  this  adds  to  the  region’s  intensity  without  changing  the 
gradient,  the  regions  should  then  appear  sourcelike.  This  should  not  be  considered  a 
drawback,  for  people  perceive  a source  under  the  same  conditions!  Figure  9 is  an  example. 
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This  effect  was  also  noted  by  [Wallach,  1963], 

A set  of  programs  was  implemented  to  run  the  S-operator  at  points  in  an 
image.  It  is  evalutated  at  varying  distances  from  an  edge(for  details  of  the  parser,  see 
[Marr,  1974]),  ignoring  values  which  are  within  an  edge  mask  width  of  the  center.  A 
suitably  conservative  criterion  is  to  consider  only  those  s-values  which  exceed  twice  the  sum 
of  the  intensities  at  the  point  of  measurement.  Some  examples  of  the  operator’s  results  may 
be  found  in  figure  10. 

An  interesting  sidelight  concerns  the  values  the  S-operator  delivers  when 
run  across  an  edge  which  is  caused  by  a shadow.  High  source  values  occur,  which  suggest 
that  shadows  might  be  aptly  characterized  as  regions  where  the  intensity  is  smaller  than  the 
gradients  would  suggest.  Thus  knowing  the  s-values  might  allow  the  classification  of 
shadow  regions.  This  conjecture  has  not  been  fully  explored. 
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Figure  9 
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Typm  8 Ligfht  Soaroe  Bf foots 

When  the  virtual  image  of  the  source  is  small,  either  because  the  source 
is  far  away  or  the  surface  reflecting  it  is  small,  a small  bright  blob  occurs  in  the  visual  field. 
This  Is  the  '.ype  i light  source  effect 

Usually  if  one  were  able  to  look  closer,  the  effect  would  be 
distinguishable  as  either  a type  I or  type  2 effect  Since  it  is  too  small  for  adequately 
measuring  gradients,  one  must  use  other  techniques. 

Tlie  only  relevant  property  at  first  inspection  is  its  contrast  To  look  for 
a contrast  threshold,  a surface  with  a small  hole  was  painted  with  matte  paint  and  placed  in 
front  of  a mirror.  By  using  a variable-strength  source  and  nteasuring  the  light  coming  off 
the  mirror  and  the  surface  seperately  the  contrast  of  the  blob  thus  formed  aras  computed. 
The  blob  begins  to  look  like  a source  when  the  contrast  reached  around  0.86<intenslty  ratio 
of  about  M to  IX  Since  this  is  rather  high,  we  can  conclude  that  high  contrast  is  sufficient 
for  a blob  to  be  considered  as  the  result  of  a type  3 light  source  effect 

One  additional  factor  which  must  be  considered  is  flare.  Flare  is  the 
beam-like  extensions  from  the  image  of  a source,  and  is  caused  by  diffraction  in  the 
imaging  system.  This  makes  it  a very  strong  clue  to  a blob  being  caused  by  a light  source 
effect,  because  below  a certain  diameter  of  spot  size,  the  diameter  is  a function  of  incident 
Intensity  rather  than  angular  sixe[Graham,l965].  Therefore  flare  Is  also  a sufficient 
condition  for  ascribing  a blob  to  a type  3 light  source  effect  One  may  find  flare  also  in 
cases  where  Type  I or  Type  2 methods  are  applicable,  especially  if  the  reflected  intensity  is 
quite  high,  and  should  be  regarded  as  a sufficient  condition  for  those  cases  aba 
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Conclusions 

Light  source  effects  form  valuable  clues  to  the  perception  of  surface 
luster.  They  cause  source  dependent  regions  in  one  of  three  ways,  each  of  which  is 
detectable  in  the  context  of  single  view  achromatic  images. 


Sug^sfostions  for  Future  Work 

1)  People  seem  to  distinguish  between  calling  some  region  a source  or  a 
light  source  effect  according  to  the  context  of  the  regions  which  contain  it.  For  example, 
inducing  a point  specularity  in  the  middle  of  a planar  surface  does  not  cause  the  surface  to 
become  shiny,  yet  in  other  cases  such  as  an  automobile  bumper,  it  does.  There  may  also  be 
some  ranges  of  contrast  and/or  s-values  which  correspond  to  “shine"  rather  than 
"source'(Cox,  in  preperation). 

2)  As  mentioned  earlier,  the  i-operator  reacts  strongly  at  shadow 
boundaries.  This  may  enable  a semi-local  process  to  isolate  which  regions  in  an  image  are 
shadows,  a result  that  would  be  nicely  complementary  to  light  source  effects  in  deciding  how 
a vision  system  should  arrive  at  illumination  assumptions,  u well  as  simplifying  recognition 
even  more. 

S)  If  one  assumes  that  a well  defined  gradient  and  average  intensity  exist 
on  a region,  the  ratio  of  the  region’s  gradient  and  intensity  is  approximately  proportiodkl  to 
sin(i)/cos(e),  where  the  constant  of  proportionality  is  related  to  the  illumination.  This  is 
perhaps  the  simplest  quantity  which  can  be  measured  locally  in  an  image  which  directly 
links  the  illumination  and  the  orientation  of  a surface,  and  therefore  might  be  useful  In 
giving  a rough  orientation  estimate  given  an  assumption  about  the  illumination.  A piece  of 
evidence  which  supports  the  linking  of  illumination  assumptions  with  orienUtion  estimates 
is  the  Mach  illusion  CBeck,  19741 
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